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,  A  very  fruitful  approach  to  the  solution  of  image  segmentation  and  surface 
reconstruction  tasks  is  their  formulation  as  estimation  problems  via  the  use 
I  of  Markov  random  field  models  and  Bayes  theory.  However,  the  Maximum  a 

I  Posteriori  (MAP)  estimate,  which  is  the  one  most  frequently  used,  is  suboptimal 

I  in  these  cases.  We  show  that  for  segmentation  problems,  the  optimal  Bayesian 
estimator  is  the  maximizer  of  the  posterior  marginals,  while  for  reconstruction 
tasks,  the  thresholded  posterior  mean  has  the  best  possible  performance.  We 
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ABSTRACT :  A  very  friiit^ful  approj^h  to  the  solution  of  image  segmentation 
and  surface  reconstruction  tasks  is  tneir  formulation  as  estimation  problems 
via  tlie  use  of  Markov  ran^m  field  models  and  Bayes  theory.  However,  the 
Maximum  a  Posteriori TMAP^estinaie,  which  is  the  one  most  frequently 
used,  is  suboptimal  in  these  c^ses.  Weshowj^that  for  segmentation  problems, 
the  optimal  Bayesian  estimated  is  the  maximizer  of  the  posterior  marginals, 
while  for  reconstruction  tasks^^the  thresholded  posterior  mean  has  the 
best  possible  performance.  -Wc-pfcsent-efficient  distributed  algorithms  for 
approximating  these  estimates  in  the  general  case.  Based  on  these  results, 
-we  develop^  maximum  likelihood  procedure  that  leads  to  a  parameter-free 
distributed  ^gorithm  for  restoring  piecewise  constant  images.  To  illustrate 
tliese  ideas,  the  reconstruction  of  binary  patterns  is  discusse^in  detail. 
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1.  Introduction. 


A  ver\  powerful  approach  for  solving  computational  early  vision  problems  is 
to  formulate  them  as  estimation  problems.  The  estimates  arc  based  on  probabilistic 
models  that  embody  both  our  prior  generic  knowledge  about  the  behavior  of 
the  solution,  as  w-ell  as  the  process  by  which  the  observations  are  obtained.  In 
particular,  various  researchers  have  used  Bayesian  estimation  and  Markov  Random 
Field  (MRF)  models  to  perform  image  segmentation  (Elliot  ei.  al.  (1983);  Hansen 
and  Elliot  (1982):  Geman  and  Geman  (1983);  Marroquin  (1984b);  (2ohen  and 
Cooper  (1984))  and  surface  reconstruction  tasks  (Marroquin  (1984a)).  Most  of  these 
researchers  have  assumed  that  the  Maximum  a  Posteriori  (MAP)  estimate,  which 
is  defined  as  the  configuration  which  maximizes  the  posterior  distribution,  provides 
the  best  possible  solution  to  these  problems,  and  several  methods  (such  as  dynamic 
programming  and  ’’simulated  annealing”  (Kirkpatrick,  et.  al.  (1983)),  a  form  of 
stochastic  relaxation)  have  been  proposed  to  compute  iL 

Let  us  consider,  however,  the  example  portrayed  in  figure  1. 

Panel  (c)  represents  the  MAP  estimate  of  the  binary  MRF  (a)  (whose  parameters 
are  assumed  to  be  knowm)  from  the  noisy  observations  (b).  It  is  clear  that  the 
estimates  shown  in  (d)  and  (e)  (which  we  will  describe  later)  are  better  than  the  MAP 
estimate  from  almost  any  viewpoint.  This  suggests  the  use  of  criteria  other  than 
the  value  of  the  posterior  probability  to  measure  the  performance  of  an  estimator. 
In  particular,  we  propose  the  use  of  the  following  criteria  for  the  two  classes  of 
problems  mentioned  above: 

1.1.  Error  Criterion  for  the  Segmentation  Problem. 


Consider  a  field  i  with  N  elements  each  of  which  can  belong  to  one  of  a  finite 
set  Qi  of  classes.  Let  i,  denote  the  class  to  which  the  element  belongs.  The 
segmentation  problem  is  to  estimate  x  from  a  set  of  observations  {yi,  •  •  ;yp}-  Note 
that  xi  does  not  necessarily  correspond  to  the  image  intensity.  It  may  represent,  for 
example,  the  texture  class  for  a  region  in  the  image  (as  in  Elliot  eL  al.,  1983),  etc. 

A  reasonable  criterion  for  the  performance  of  an  estimate  x  is  the  number  of 
elements  that  are  not  classified  correctly.  Therefore,  we  define  the  segmentation 
error  as: 

i)  =  H  (1  “  “  *•))  .  *.•  €  Qi  (1) 


where 


'  ’  lo,  otherwise 


(2) 


1 


L 


Figure  1.  (a)  Sample  funciion  of  a  binan  MRF.  (b)  Output  of  a  binary  symmetric  channel 
(error  rate;  0.4)  (c)  MAP  estimate,  (d)  Monte  Carlo  approximation  to  the  MPM  estimate,  (e) 
Deterministic  approximation  to  the  MPM  esumate. 

1.2.  Error  Criterion  for  the  Reconstruction  Problem. 

In  this  case,  we  also  consider  a  field  i  with  N  elements  which  can  take  values 
on  finite  sets  {$,},  but  now  we  assume  specifically  that  represents  the  intensity 
of  an  image  (or  the  height  of  a  surface)  at  site  i.  This  suggests  that  an  estimate  i 
should  be  considered  "good"  if  it  is  close  to  i  in  the  ordinary  sense,  so  that  the 
total  squared  error: 

«r(2,i)=  (3) 

tKi 


will  be  a  reasonable  measure  for  its  performance. 

Let  us  now  derive  the  optimal  estimators  for  these  error  criteria. 


1  Oplimal  Bayesian  Estimators. 

In  this  section  we  introduce  two  estimators  based  on  the  posterior  distribution 
Pj.j,:  The  Maximizer  of  the  posterior  marginals  which  is  obtained  by 

maximizing  separately  the  posterior  marginal  distribution  of  each  element,  and  the 
Thresholded  posterior  mean  irrM-  Their  formal  definition  is  as  follows: 

XMPM{i)  =  q  :  -P.-iyC?: !/)  =  sup  y)}  (4) 

reQi 

where  Pj-.j  is  the  posterior  marginal  distribution  of  the  element: 


The  TPM  estimate  is: 


XTPMii)  =  q  :  {q-Xif=  inf  {(»■  -  5.)^} 

fcSi* 


w'here  x  is  the  posterior  mean: 


2  = 


We  will  show  that  the  MPM  and  TPM  estimators  are  optimal  with  respect  to  the 
error  criteria  (1)  and  (3)  respectively.  In  what  follows,  we  will  assume  that  the  prior 
and  conditional  distributions  P*,  P^,,  are  known,  so  that  the  posterior  distribution 
can  be  obtained  from  Bayes  rule. 

Proposition  1:  x^pm  is  optimal  with  respect  to  the  segmentation  error  e,. 

This  is  not  a  new  result  (see  for  example  Abend,  1968);  however,  we  present  here 
a  simple  proof; 

Let  a  =  ijvfPAi,  and  let  r  denote  any  other  estimate  for  x.  We  will  show  that 

E\e,ix,x)]  <  E\t,[x,z)] 

where  the  expectation  is  taken  over  all  z  and  all  possible  observations  y. 

For  any  fixed  y  we  have,  from  (1): 


e,(i  I  y)  =  E\t,{x,x)  i  y]  =  £(1  -  6[xi  -  y) 

X  t'sl 

=  Z  E  v)  -  E  (1  -  y)) 


with  Pyy  given  by  (5).  Also, 


s 


t=i 


Therefore, 

e.(i  I  y)  -  e* (2 1  y)  =  -  H  y)  -  Px^i\ y)]  (8) 

t=i 

But  by  the  definition  (4)  of  i,  each  term  on  the  right  hand  side  of  (8)  is  non-positive, 
so  that 

i,{z  I  y)  -  et{z  (  y)  <  0  for  all  y 

and  therefore, 

E{e,{x,2)]<E{c,{x,z)]  I 


Note  that  we  have  not  made  any  assumption  about  P^j,,  or  {Q,},  so  that 
this  is  a  completely  general  result.  In  particular,  the  sets  of  valid  classes  Qi  do  not 
have  to  be  the  same  for  all  i  ,  so  that  this  result  holds  if,  as  in  Geman  and  Geman 
(1983),  X  is  the  pair  {/,!},  where  /  denotes  the  intensity  of  a  piecewise  constant 
image,  and  I  the  boundaries  between  unifonn  regions. 

Proposition  2:  xt/’m  is  optimal  w'ith  respect  to  the  reconstruction  error  Cr. 

Proof:  Again,  we  put  x  =  xtpmx  and  let  2  denote  any  other  estimate.  For  any  fixed 
y  we  have,  from  (3): 


cr(i  I  y)  =  ~ ii)^P,|y{i;y) 

*  1=1 


=  E  E(*i  “  +  i?)P,|y(i;  y) 

1=1  * 

«— 1 

where 

*  E  y) 

X 

«r(2  I  y)  *  E  Pi  “  1 


also, 


so  that 


lr{i  i  1/)  -  tr{z  i  ]/)  =  53  ~  ^  ® 

1^] 


from  the  definition  (6)  of  i  i 
Remarks: 

1.  In  the  limit  of  fine  quantization  the  variables  i,  become  continuous  (i.e.,  Qi  =R 
for  all  i).  Jn  this  case  we  recover  the  classical  result  that  establishes  that  the  posterior 
mean  minimizes  the  mean  squared  error;  for  the  particular  case  of  Gaussian  (Habibi, 
1972;  Nahi  and  Assefi,  1972)  or  isotropic  fields  (Levy  and  Tsitsiklis,  1983),  it  is  then 
possible  to  construct  efficient  algorithms  that  compute  this  quantity. 

2.  The  surface  reconstruction  problem  treated  by  Marroquin  (1984a)  can  be 
considered  a  particular  instance  of  the  reconstruction  problem  defined  here.  If  we 
let  X  be  the  pair  {/,/},  where  /  is  the  (continuous  valued)  depth  process  and  I  is 
a  binary  line  process,  the  optimal  estimator  will  bt  it  pm  (note  that  for  a  binary 
variable,  xtpm{^)  =  ^MPMii))- 

3.  These  results  can  also  be  applied  to  the  case  of  an  m-ary  line  process  (like  the 
one  suggested  by  Geman  and  Geman  (1983))  b)'  defining  an  appropriate  mixed 
error: 

<™(/.  i,  /,  i)  - 1;  (/i  -  /.)’ + x  £  (1  -  6  (li  -  i.)) 

»=1  t-nl 

with  6  as  defined  in  equation  (2).  One  can  show,  using  arguments  similar  to  those 
of  the  proofs  above,  that  the  optimal  estimate,  for  any  positive  value  of  X  will 
be  Otpmi  '^mpm}-  Note  that  the  posterior  mean  for  /  and  the  posterior  marginal 
distributions  for  I  must  be  computed  by  averaging  over  all  possible  values  of  both 
f  and  /: 

/  I 

/  W.-* 


3.  Algorithms. 

As  in  the  case  of  the  MAP  estimate,  the  exact  computation  of  the  optimal  MPM 
and  TPM  estimates  is  a  formidable  task,  except  for  very  small  N.  It  is  possible, 
however,  to  define  general  distributed  Monte  (2arlo  procedures  that  will  allow  us  to 
approximate  these  values  as  precisely  as  we  want. 

The  general  idea  is  to  use  the  Metropolis  algorithm  (Metropolis,  1953)  to 
generate  global  configurations  of  the  field  x  which  are,  asymptoticallj’,  distributed 
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according  lo  P,  j  y.  Since  ihe  Markov  chain  defined  b\  the  Metropolis  algorithm  is 
known  to  be  ergodic  (Geman  and  Geman.  1983).  we  can  approximate  x  by: 


X{  ss 


n-k 


Jt) 


t^k 


(9) 


and  the  posterior  marginals  by: 


A,v(9) 


k  —  n 


t=^k 


(10) 


where  il'l  is  the  configuration  generated  by  the  Metropolis  algorithm  at  time  t,  and 
k  is  the  time  required  for  the  system  to  be  in  thermal  equilibrium.  From  these 
values,  XMPM  and  can  be  easily  computed  using  (4)  and  (6). 

If  we  compare  this  procedure  w-iih  the  use  of  "Simulated  annealing"  (Kirkpatrick, 
et.al..  1983)  for  approximating  the  MAP  estimate,  we  note  that  even  from  a 
computational  viewpoint  it  has  some  distinct  advantages: 

1.  It  is  difficult  to  determine  in  general  the  descent  rate  of  the  temperature 
(annealing  schedule)  that  will  guarantee  the  convergence  of  the  annealing 
process  in  a  reasonable  time  (it  usually  involves  a  trial  and  error  procedure). 
Since  we  are  running  the  Metropolis  algorithm  at  a  fixed  temperature  (T  =  1), 
this  issue  becomes  irrelevant, 

2.  Since  in  our  case  we  are  using  a  Monte  Carlo  procedure  to  approximate 
the  values  of  some  integrals,  we  should  expect  a  nice  convergence  behavior,  in 
the  sense  that  coarse  approximations  can  be  computed  very  rapidly,  and  then 
refined  to  an  arbitrary  precision. 

The  main  disadvantage  of  this  procedure  is  that  in  the  case  of  the  segmentation 
problem,  a  large  amount  of  memory  might  be  required  if  the  number  of  classes 
per  element  m  is  large  (we  need  to  store  the  N{m  - 1)  numbers  that  define  the 
posterior  marginals). 

With  respect  to  the  relative  performance,  we  point  out  that  for  high  signal  to 
noise  ratios,  the  MAP  estimate  is  usually  close  to  the  optimal  one  (which  explains  its 
good  performance  in  many  cases).  If  the  noise  level  is  high,  however,  the  difference 
in  the  performances  of  the  two  estimators  may  be  dramatic  (see  fig,  1). 

Finally,  from  a  conceptual  viewpoint,  the  definition  of  the  solution  of  the 
estimation  problem  in  terms  of  the  posterior  mean  (or  the  posterior  marginals) 
may  lead  in  some  cases  to  the  construction  of  efficient  deterministic  algorithms  for 
approximating  the  solution.  To  make  these  ideas  concrete,  we  now  analyze  in  detail 
a  specific  instance  of  the  segmentation  problem. 
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4.  Optimal  Sei;mcntation  of  Binarj  MRFs. 

In  this  section  we  will  consider  the  following  paniciilar  example  of  the  general 
segmentation  problem: 

Let  /  represent  a  binary  pattern  on  a  rectangular  lattice  L  with  A’  elements, 
which  is  a  particular  realization  of  a  Markov  Random  Field  w'ith  potentials  given 
by: 


f-l.  if  /,  =  /y  and  IK-; II  6  (0,1] 

y[!u  /,)  =  j  1,  if  /,  ^  fj  and  jj:  -  j\\  £  (0, 1] 

lo,  otherwise 

where  i  and  j  are  sites  of  L  and  |K  -  ;||  is  the  distance  betweeen  i  and  ;  (i.e.,  / 
is  a  realization  of  a  two-dimensional  Ising  net).  Without  loss  of  generality,  w-e  will 
assume  that  /,•  €  {0, 1}  for  all  t  €  L. 

The  probability  density  of  the  configurations  F  is  given  by: 

=  /)=  jexp|-^y(/))  (11) 

where  7  is  a  normalizing  constant;  the  energy  U{f)  is: 

‘t>6A’A' 


where  i,j  £  A>  means  that  i  and  j  are  nearest  neighbors,  and  To  is  the  natural 
temperature  of  the  system. 

Suppose  that  /  is  sent  through  a  binary  symmetric  channel  with  error  rate  e, 
so  that  the  conditional  distribution  of  the  observations  g  is: 


P(9.  I /.)  =  {[] 


if  9i  =  /, 
if  9i  7^  /» 


The  posterior  distribution  is: 


Pf\g{f>9) 


(12) 


where  Zpisa  constant,  and  the  posterior  energy  Up  is; 


K', 


Using  equations  (1)  and  (12),  it  is  not  difficult  to  write  down  the  exact  expressions 
for  the  average  segmentation  error  corresponding  to  tlie  MAP  and  MPM  estimators 
for  this  problem.  However,  the  numerical  evaluation  of  these  expressions  is  feasible 
only  for  small  values  of  N. 

In  figure  2  we  show  a  plot  of  the  ratio; 


^  _  E\cmap] 


for  a  2  X  2  lattice,  for  different  values  of  tJie  error  rate  e  and  the  natural  temperature 
To.  As  expected,  r  is  never  less  than  1.  In  the  worst  case  (for  e  =  0.1  and  To  =  0.2) 
the  error  of  the  MAP  estimate  is  1.17  limes  that  of  the  MPM  estimate;  if  To  is  not 


I-"'.  ''. 
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too  small  and  e  is  not  too  large,  both  estimates  coincide,  and  as  (  approaches  0.5 
(low  signal  to  noise  ratio),  tlie  MPM  estimate  is  consistent!)  better  than  the  MAP. 
An  experimental  anal)  sis  of  larger  lattices  reveals  a  similar  qualitative  behavior,  but 
the  values  of  r  are  much  larger  in  this  case. 

4.2.  Example. 

We  now  return  to  the  example  presented  in  figure  1.  and  examine  it  in  more 
detail.  Panel  (a)  represents  a  typical  realization  of  a  64  x  64  Ising  net  w-ith  free 
boundaries,  using  a  value  of  To  =  1.74  (0.75  times  the  critical  temperature  of  the 
lattice):  panel  (b).  the  output  of  a  binary  symmetric  channel  with  error  rate «  =  0.4; 
panel  (c)  the  MAP  estimate,  and  panel  (d)  an  approximation  to  the  MPM  estimate 
(which  we  will  label  "MPM  (M.C.)")  obtained  using  the  Metropolis  algorithm  and 
equation  (10)  to  estimate  the  posterior  density.  The  corresponding  values  of  the 
posterior  energ)  Up  (equation  (13))  and  the  relative  segmentation  error  (c,/64‘)  are 
shown  on  table  1. 

Table  1 


/  ff  /map  /mPmP«^-) 


Energy  -5594.8  -226.0  -6660.9  -6460.0  -6427.0 

Seg.  Error  -  0.4  0.33  0.128  0.124 


4.3.  A  Fast  Algorithm.  ' 

For  this  problem,  it  is  possible  to  construct  a  fast  deterministic  algorithm  whose 
experimental  performance  (in  lenns  of  the  average  segmentation  error)  is  equivalent 
to  the  Monte  Carlo  method  discussed  above.  It  is  based  on  the  following  ideas: 

First,  we  note  that  for  a  binary  pattern,  the  MPM  and  TPM  estimates  coincide. 
We  w'ill  approximate  the  posterior  mean  of  (12)  by  that  of  a  Gaussian  distribution 
Pc  with  the  property: 

Pc[h)  =  for  all  h  €  {0, 1}. 

Zp 

In  particular,  we  use: 

Pcih)  =  exp[-^  53  (^t  - 

For  this  distribution,  ^  is  the  (unique)  minimizer  of  the  convex  function: 
VgW  =  -^  r 


which  corresponds  lo  ihe  unique  fixed  point  of  the  system: 


'  lA’.i  +  aro 


(14) 


where 

A’.  =  {;€l  :  IK-;||  =  i}- 

We  could  now  approximate  our  estimate  by  putting: 


h  =  ©(^.O 


where 


if  2  >  j 
otherwise 


(15) 


There  is  an  additional  consistency  condition  that  f  must  satisfy,  however.  It  can 
be  showT.  that  w-hen  the  posterior  distribution  has  the  form  given  by  (12)  and  (13), 
the  MPM  estimate  /,  which  by  definition  satisfies: 


>  -P.ioCCi  ~ /t);  ff) 


also  satisfies: 

“/.•);/)  (16) 

which  means  that  if  we  replace  the  observations  by  the  MPM  estimate,  and  compute 
a  new  MPM  estimate  for  this  modified  problem,  we  should  get  the  same  result. 

Translating  this  condition  to  the  case  of  /  ,  we  get  that  it  must  satisfy; 


/  ■  =  ©(^*) 

where  h*  satisfies: 

LygAT,  oTo0(/i,- ) 

IN.I  +  aTo 

In  practice,  we  get  h'  as  the  fixed  point  of  the  system: 

‘  1^,1  + or. 


(17) 


(18) 


with 
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Noie  that  ihe  function; 


('•/,('■)=  E  (fc,  -y=  +  ar„E('>.  -e('>.)f 

«,j6A\  « 


acts  as  a  Lyapunov  function  for  the  system  (18).  which  is  therefore  (locally)  stable 
(X'idyasagar,  1978). 

This  algorithm  can  be  visualized  as  operating  in  two  steps;  In  the  first  one, 
we  extract  all  the  information  that  we  need  from  the  observations  and  encode  it  in 
h  (which  is  continuous-valued),  and  in  the  second  one,  we  find  the  closest  binary 
pattern  that  satisfies  the  consistency  condition  (16). 

• 

To  illustrate  the  performance  of  this  approximation,  we  show  /  ,  for  the 
example  discussed  above,  in  panel  (e)  of  figure  1,  and  its  corresponding  energy  and 
segmentation  error  in  the  last  column  of  table  1  (labeled  "MPM  det"). 


4.4.  Dimensionality  of  the  Parameter  Space. 

Equations  (14)  and  (18),  which  describe  the  deterministic  approximations  to 
fMPM  depend  on  the  parameters  of  the  system,  t  and  To,  only  through  the  product: 

^  =  aro  =  rolog(i~)  (19) 

w'hich  means  that  the  behaviour  of  the  algorithm  is  completely  characterized  by  the 
single  parameter  7.  In  the  case  of  the  Monte  Carlo  approximation  (10),  if  we  fix 
the  value  of  7,  the  value  of  7b  cannot  be  chosen  arbitrarily,  since  it  has  to  satisfy 
the  consistency  condition; 

ro  =  ? 

a 

with 

4  =  Iog(l^j  ; 

»wi 

where  z  is  the  residual  process  defined  as; 

fi  ^  9i 
0,  Otherwise 


(20) 


(21) 
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This  means  ihai.  given  the  correct  value  of  To  can.  in  principle,  be  determined 
in  an  adapii\e  wa\,  so  that  in  this  case  too,  the  behaviour  of  the  approximation 
depends  effectively  only  on 


5.  Simultaneous  Estimation  of  the  Field  and  the  Parameters. 

The  above  considerations  suggest  that  we  can  estimate  simultaneously  the 
original  field  and  the  parameters  of  the  system  by  looking  for  the  supremum  of  an 
appropriate  likelihood  function  over  the  one-dimensional  subspace  parametrized 
by  We  proceed  as  follows: 

For  a  given  value  of  we  can  approximate  the  corresponding  MPM  estimate 
/  using  the  methods  developed  in  the  previous  section,  and  compute  the  residual 
process  z  and  the  conditional  (on  7)  Maximum  Likelihood  Estimate  of  the  error 
rate  c  using  equations  (20)  and  (21).  The  corresponding  conditional  estimate  for  To 
will  be: 

To  =  ?  (22) 

o 


To  measure  the  "likelihood"  of  the  estimate  /,  we  use  the  degree  of  uniformity 
(or  "whiteness")  of  the  residual  process  2.  This  propeny  can  be  quantified  by  the 
variance  of  the  local  noise  density,  which  we  estimate  as  follows: 

We  cover  the  lattice  with  a  set  {Sy}  of  m  non-overlapping  squares  (say,  8 
pixels  wide).  For  each  square  Sj,  the  relative  variance  of  the  noise  density  is; 


Pjl  »es, 

where  \Sj\  is  the  area  of  the  y*'*  square. 

The  desired  likelihood  function  is: 

Lif)  =  -  E  (24) 

y-i 

Note  that  a  more  conventional  likelihood  function,  such  as  the  conditional 
likelihood  proposed  by  fiesag  (1972),  will  not  work  in  this  case;  this  function  is 
defined  as: 

U^f)  =  with 

W)=  n 

»€C* 


v-y..'C-v-vv> 
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Ji 


exp;-+  Ej.a,  1'(/„//)1  ^  expi-^  r(l  -  /,,/,)] 

J  Q  Jo  • 

=  n  (1  +  “PIT-  E  /;)])■’.  *  =  1. 2 

•CCn  Jq  j6A, 

where  the  ''codings"  Ci  and  Co  are  seis  of  conditionally  independent  sites  defined 
as: 


=  n 

t£C. 


Cl  =  {i  :  (2,  is  odd  and  j/i  is  even)  or  (2,  is  even  and  y,  is  odd)} 

C2  =  {:  :  (2,  is  odd  and  y,is  odd)  or  (x^  is  even  and  y,  is  even)} 

with  (2,,y,)  denoting  the  row  and  column  indices  of  site  i.  In  our  case,  we  find 
that  as  'y  decreases,  /  becomes  more  and  more  uniform,  while  7b  remains  almost 
constant.  It  is  not  difficult  to  see  that  as  a  result,  the  conditional  likelihood  L  will 
decrease  monotonicallt  with  -7,  which  renders  it  useless  for  our  purpose. 

The  range  of  values  ['ro.'TA^j  of  the  parameter  -y  that  corresponds  to  the  class 
of  st’stems  of  interest  can  be  determined  as  follows: 

One  can  show  that  for  7  >  8  we  will  always  have  /mpmi  =  fft  ^or  all  t,  so  that 
we  can  use  'tm  —  8-  The  value  of  70  can  be  obtained  from  an  upper  bound  for  c 
and  a  lower  bound  for  7b.  For  example,  assuming  that  c  <  .45  and  To  >  .ST*,  we 
get  70  =  .23.  (Note  that  when  the  natural  temperature  lb  of  a  first  order,  isotropic 
MRF  is  below  0.5  times  (the  critical  temperature  of  the  lattice;  see  Kindermann 
and  Snell,  1980),  the  patterns  become  practically  uniform  (i,e.,  /,  =constant  for  all 
t),  w'hile  for  values  of  To  greater  than  l.5T«,  we  get  patterns  ^at  are  practically 
indistinguishable  from  white  noise.  Therefore,  the  assumption  To  >  .STc  covers 
practically  all  the  interesting  cases). 

The  complete  estimation  procedure  is  as  follows: 

Maximum  Likelihood  Estimation  Algorithm: 

1:  Sample  the  interval  I70,  7m]  at  the  points 

70  <  7li  •  •  7n  <  7m 

2:Foreach7€C«{7i,.--7n} : 

2.1:  Find  7(7)  using  (14)  and  (18). 

2.2:  Compute  2  using  (21). 

2.3:  Compute  i  using  (20).  If «  «  0,  set  L(J’(7))  =  -oc  and  proceed  with  the 
next  value  of  7.  Otherw'ise,  compute  d  and  go  to  2.4. 

2.4:  Compute  7b  using  (22). 
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Figure  3.  (a)  Synthetic  image,  (b)  Noisy  observations,  (c)  Maximum  Likelihood  Estimate. 


2.5:  Compute  1(7(7))  using  (23)  and  (24). 

3:  Compute  the  optimal  estimate  /  using: 

7*  =  7(7*)  :  1(7(7*))  *  sup  1(7(7))  (25) 

l€Q 

The  corresponding  e’.to  will  be  the  optimal  estimates  for  c  and  To,  respectively. 
Remarks: 

1.  This  estimation  algorithm  allows  us  to  reconstruct  a  binary  pattern  /  from 
the  noisy  observations  g  without  having  to  adjust  any  free  parameters.  The  only 
prior  assumptions  correspond  to  the  qualitative  structure  of  the  field  /  (first  order, 
isotropic  MRF)  and  to  the  nature  of  the  noise  process,  but  neither  the  natural 
temperature  To  nor  the  error  rate  c  ha\ :  to  be  known  in  advance.  In  practice,  this 
means  that  we  can  apply  it  to  restore  any  binary  image  with  uniform  granularity, 
even  if  it  has  not  been  generated  by  a  Markov  random  process.  We  have  used  this 
algorithm  to  reconstruct  a  variety  of  binary  images  with  excellent  results.  In  figure  3 
we  show  such  a  restoration.  The  observations  (b)  were  generated  from  the  synthetic 
image  (a)  with  an  actual  error  rate  of  .35  (assumed  unknown).  The  MLE  for  /  is 
shown  in  (c). 

I  This  procedure  can  be  easily  extended  to  handle  any  one-parameter  noise 
corruption  process  (such  as  zero  mean,  additive  white  Gaussian  noise).  The  extension 


to  the  case  of  N-ary  fields,  i.e.,  to  the  restoration  of  piecewise  constant  images,  is 
also  straightforward  (using  the  general  algorithm  (10)  together  with  equation  (4) 
instead  of  (14)  and  (18)  in  step  2.1). 

3.  We  have  found  that  the  likelihood  funaion  (24)  is  reasonably  well  behaved  as 
a  function  of  7.  This  permits  us  to  perform  the  one-dimensional  search  for  its 
supremum  in  an  economical  way,  by  first  determining  its  approximate  location  using 
a  coarse  sampling  pattern,  and  then  refining  its  position  by  a  fine  sampling  of  a 
reduced  interval.  In  practice,  it  is  possible  to  get  very  good  results  using  on  the 
order  of  15  samples. 

4.  The  whole  procedure  is  highly  distributed,  so  that  it  is  possible  to  implement  it 
in  parallel  hardware  in  a  very  efficient  way. 

6.  Conclusions. 

A  very  fruitful  approach  to  the  solution  of  image  segmentation  and  surface 
reconstruction  tasks  is  their  formulation  as  estimation  problems,  via  the  use  of 
MRF  models  and  Bayes  theory .  However,  the  MAP  estimate,  which  has  been  often 
used,  will  not  always  give  the  best  solution.  We  have  shown  that,  for  segmentation 
problems,  the  optimal  Bayesian  estimator  is  the  maximizer  of  the  posterior  marginals 
(MPM),  while  for  reconstruction  tasks,  the  thresholded  posterior  mean  (TPM)  has 
the  best  possible  performance.  In  some  cases,  these  estimators  will  give  results 
that  are  similar  to  those  obtained  by  the  MAP  procedure,  but  in  many  interesting 
situations  (in  particular  for  low  signal  to  noise  ratios)  their  performance  will  be 
significantly  better. 

The  exact  computation  of  these  estimates  (including  the  MAP)  is  computationally 
unfeasible  in  most  practical  situations.  We  have  presented  a  general  Monte  Carlo 
procedure  which  approximates  their  value  as  precisely  as  desired  (at  the  expense  of 
increased  computational  cost).  This  procedure  can  be  easily  implemented  in  parallel 
hardware,  and  it  has  the  advantage  that  coarse  solutions  are  computed  very  fast, 
and  are  then  progressively  refined.  We  have  also  shown  how  in  particular  cases,  it  is 
possible  to  use  the  conceptual  framework  provided  by  these  estimators  to  construa 
fast  algorithms  with  very  good  experimental  performance. 

Finally  ,  we  have  developed  a  maximum  likelihood  procedure  for  the  simul* 
taneous  estimation  of  a  piecewise  constant  field  and  the  parameters  of  the  system. 
This  construction  leads  to  a  parameter-free  distributed  algorithm  for  reconstructing 
piecewise  constant  images  from  noisy  observations. 
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